Image storage apparatus, image reproducing apparatus, mehod of storing image, method of reproducing an image, recording medium and photographing apparatus

ABSTRACT

An image storage apparatus, an image reproducing apparatus, a method of storing an image, a method of reproducing an image, a storage medium and a photographing apparatus are provided. The image storage apparatus records link information of a contents file within a moving image file and stores the linked moving image file. Accordingly, a user can select the moving image file to be displayed together with the linked contents file on one screen when the user reproduces the moving image file.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/218,001, filed on Aug. 25, 2011, which claims the benefit under 35U.S.C. §119 from Korean Patent Application No. 10-2010-0083021, filed onAug. 26, 2010, in the Korean Intellectual Property Office, thedisclosures of each of which are incorporated herein by reference intheir entirety.

BACKGROUND

1. Field of the Invention

The present general inventive concept generally relates to an imagestorage apparatus, an image reproducing apparatus, a method of storingan image, a method of reproducing an image, a recording medium, and aphotographing apparatus, and more particularly, to an image storageapparatus to store a photographed image, an image reproducing apparatus,a method of storing an image, a method of reproducing an image, arecording medium, and a photographing apparatus.

2. Description of the Related Art

In recent years, camcorders provide various functions other than afunction to photograph an image. In addition, the camcorders could editvarious photographed images according to a user's desired editingeffect.

For example, the camcorders may provide a function to record thephotographed image by including a still image as one file type. At thistime, the camcorders are configured to add track data for a still imagewithin a moving image file in a standard MP4 file format (i.e., MotionPicture Experts Group MPEG-4 file format) and to record the moving imagefile in which the track data is added.

However, in the case where a still image is provided in a recordedmoving image and the stored as one file by using the above method, it isimpossible to assist the reproducing function in the general-purposeplayer. Moreover, a user cannot reproduce only the still image dataincluded in a moving image file to watch the still image data.

SUMMARY

Accordingly, there is a demand for a method for providing function toadding content to a moving image. The present general inventive conceptprovides an image storage apparatus which records link information of acontents file within a moving image file and stores the moving imagefile including the link information when storing the moving image file,and a method of storing an image applied thereto.

Additional embodiments of the present general inventive concept will beset forth in part in the description which follows and, in part, will beobvious from the description, or may be learned by practice of thegeneral inventive concept.

Exemplary embodiments of the present general inventive concept mayprovide an image storage apparatus, including a storage unit to store amoving image file and a contents file are stored, and a controller torecord link information of the contents file within the moving imagefile and to store the moving image file.

The moving image file may be a file of a moving picture experts group 4(MPEG-4) standard.

The controller may record the link information of the contents filewithin a meta box of the MPEG-4 standard.

The controller may record the link information of the contents filewithin a user-defined data box of the MPEG-4 standard.

The link information of the contents file may include a file name of thecontents file, a reproducing starting time point, and reproducing timeinformation.

The contents file may be one of a moving image contents file, a stillimage contents file, and a text contents file.

Exemplary embodiments of the present general inventive concept may alsoprovide an image reproducing apparatus including a storage unit to storea contents file and a moving image file, the moving image file in whichlink information of the contents file are recorded together with amoving image, and a controller to control a reproducing screen of themoving image file together with a reproducing screen of the contentsfile to be displayed for a specific period based on the linkinformation.

The moving image file may be a file of an MPEG-4 standard.

The link information may be recorded within a meta box of the contentsfile according to the MPEG-4 standard.

The link information may be recorded within a user-defined data box ofthe contents file according to the MPEG-4 standard.

The link information of the contents file may include a file name of thecontents file, a reproducing starting time point, and reproducing timeinformation, and the specific period may be a period from thereproducing starting time point to a time point in which the reproducingtime is terminated.

The contents file may be one of a moving image contents file, a stillimage contents file, and a text contents file.

Exemplary embodiments of the present general inventive concept may alsoprovide a method of storing an image, including storing a contents file,and recording link information of the contents file within a movingimage file and storing a moving image file in which the link informationis recorded.

The moving image file may be a file of an MPEG-4 standard.

The link information of the contents file may include a file name of thecontents file, a reproducing starting time, and reproducing timeinformation.

Exemplary embodiments of the present general inventive concept may alsoprovide a method of reproducing an image, including reproducing a movingimage file, and displaying a reproducing screen of the moving image filetogether with a reproducing screen of a contents file linked by linkinformation for a specific period based on the link information recordedwithin the moving image file.

The moving image file may be a file of an MPEG-4 standard.

The link information of the contents file may include a file name of thecontents file, a reproducing starting time and reproducing timeinformation and the specific period may be a period from the reproducingstarting time point to a time point in which the reproducing time isterminated.

Exemplary embodiments of the present general inventive concept may alsoprovide a computer-readable recording medium that includescomputer-readable codes, that when executed by a computer, carry out amethod of storing an image, the method including generating a contentsfile and a moving image file of an MPEG-4 standard are contained, andstoring the moving image file in which link information for the contentsfile is recordable within a meta box or user-defined data box of theMPEG standard.

Exemplary embodiments of the present general inventive concept may alsoprovide a photographing apparatus, including a camera unit to photographa moving image, a capture unit to capture the moving image to generate astill image, a storage unit in which a moving image file and a stillimage file are stored, and when the still image is captured by thecamera unit during photographing the moving image by the camera unit, acontroller to store a captured still image file in the storage unit andto record link information for the still image within a moving imagefile generated by the camera unit.

The moving image file may be a file of an MPEG-4 standard.

The controller may record the link information of the captured stillimage file within a meta box or user-defined data box of the MPEG-4standard.

The link information of the still image file may include a file name ofthe still image file, a reproducing starting time point and reproducingtime information. The reproducing starting time point may be a timepoint where the still image file is captured within a reproducing timeof the moving image which is being photographed and the reproducing timemay be a preset time.

Exemplary embodiments of the present general inventive concept may alsoprovide a photographing apparatus, including a first camera unit tophotograph a first moving image, a second camera unit to photograph asecond moving image, a storage unit to store a moving image file isstored, and when the second moving image is photographed by the secondcamera unit during photographing the first moving image by the firstcamera unit, a controller to store a photographed second moving imagefile in the storage unit and to record link information of thephotographed second moving image file within a first moving image filewhich is generated by the first camera unit.

The first moving image file may be a file of an MPEG-4 standard.

The controller may record the link information for the photographedsecond moving image within a meta box or a user-defined data box of thefirst moving image file according to the MPEG-4 standard.

The link information for the second moving image file may include a filename of the second moving image file, a reproducing starting time pointand reproducing time information. The reproducing starting time pointmay be a time point where the second moving image file starts to bephotographed within a reproducing time of the first moving image whichis being photographed and the reproducing time may be a reproducing timeof the second moving image file.

Exemplary embodiments of the present general inventive concept may alsoprovide an image forming apparatus, including an image capture apparatusto capture a moving image and a still image, a memory to store thecaptured moving image and the still image, and a controller to generatea contents file including link information, where the generated contentsfile is stored within a moving image file of the captured moving imagein the memory.

The image forming apparatus may include a display to display the movingimage file and the contents file including the link information.

The contents file can include at least one of a moving image contentsfile, a still image contents file, and a text contents file.

The contents file can include a time duration to display at least one ofthe moving image and the still image.

The contents file can include a frame number of the moving image to bedisplayed.

Exemplary embodiments of the present general inventive concept may alsoprovide a method of capturing an image, the method including capturing amoving image and a still image, storing the captured moving image andthe still image in a memory, and generating a contents file includinglink information, where the generated contents file is stored within amoving image file of the captured moving image in the memory.

The method may also include displaying the moving image file and thecontents file including the link information on a display.

The contents file can include at least one of a moving image contentsfile, a still image contents file, and a text contents file.

The contents file can include a time duration to display at least one ofthe moving image and the still image.

As described above, according to exemplary embodiments of the presentgeneral inventive concept, the image storage apparatus and the method ofstoring an image applied thereto, which records the link information ofthe contents file within the moving image file and stores it when themoving image is stored, are provided so that when a user reproduces themoving image file, the moving image file can be displayed together withthe linked contents file on one screen. The contents file, which is alink target, can be independently reproduced.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other embodiments of the present general inventive conceptwill become apparent and more readily appreciated from the followingdescription of the embodiments, taken in conjunction with theaccompanying drawings of which:

FIG. 1 is a view illustrating an image storage apparatus according toexemplary embodiments of the present general inventive concept;

FIG. 2 is a view illustrating an image reproducing apparatus accordingto exemplary embodiments of the present general inventive concept;

FIG. 3 is a flowchart illustrating a method of storing an imageaccording to exemplary embodiments of the present general inventiveconcept;

FIG. 4 is a flowchart illustrating a method of reproducing an imageaccording to exemplary embodiments of the present general inventiveconcept;

FIG. 5 is a view illustrating a moving picture experts group 4 (MPEG-4or MP-4) file format according to exemplary embodiments of the presentgeneral inventive concept;

FIG. 6 is a view illustrating a method of reproducing a MP4 fileaccording to exemplary embodiments of the present general inventiveconcept;

FIG. 7 is a view illustrating a link information box according to anMPEG-4 format according to exemplary embodiments of the present generalinventive concept;

FIG. 8 is a view illustrating link information that is included within auser-defined data box according to exemplary embodiments of the presentgeneral inventive concept;

FIG. 9 is a view illustrating link information that is included within ameta data box according to exemplary embodiments of the present generalinventive concept;

FIG. 10 is a view illustrating a camcorder according to exemplaryembodiments of the present general inventive concept;

FIG. 11 is a view illustrating an example of line information for astill image file according to exemplary embodiments of the presentgeneral inventive concept;

FIGS. 12A to 12C are views illustrating methods of linking a movingimage photographed by a camcorder with a still image, storing the linkedmoving image file, and reproducing the moving image according toexemplary embodiments of the present general inventive concept;

FIG. 13 is a view illustrating a camcorder according to exemplaryembodiments of the present general inventive concept;

FIG. 14 is a view illustrating an example of link information for astill image file and a moving image file according to exemplaryembodiments of the present general inventive concept; and

FIGS. 15A to 15C are views illustrating linking a moving imagephotographed by a camcorder with another moving image, storing thelinked moving image file, and reproducing the photographed moving imageaccording to exemplary embodiments of the present general inventiveconcept.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Reference will now be made in detail to the embodiments of the presentgeneral inventive concept, examples of which are illustrated in theaccompanying drawings, wherein like reference numerals refer to likeelements throughout. The embodiments are described below in order toexplain the present general inventive concept by referring to thefigures.

FIG. 1 is a block illustrating an image storage apparatus 100 accordingto exemplary embodiments of the present general inventive concept. Asillustrated in FIG. 1, the image storage apparatus 100 can include anaudio input unit 110, an audio encoder 115, a video input unit 120, avideo encoder 125, a capture unit 130, a still image encoder 135, an MP4file format multiplexer (MUX) 140, a storage unit 150, and a controller160.

The audio input unit 110 can receive an audio signal via a wired cableor a wireless connection, and/or may receive sound waves and convertthem into an electrical signal. Specifically, the audio input unit 110may be a microphone which directly receives sound, or an audio interfacewhich receives an audio signal from another apparatus.

The audio encoder 115 can compress the received audio signal using anaudio compression such as arithmetic coding (AC), advanced audio coding(AAC), bit-sliced arithmetic coding (BSAC), moving picture experts group(MPEG) audio layer-3 (MP3), and the like to generate an audio bitstream. The audio encoder 115 can output the generated audio bit streamto the MP4 file format MUX 140. The audio encoder 115 can be anintegrated circuit, a processor, and/or any suitable encoder to carryout the exemplary embodiments of the present general inventive conceptdisclosed herein.

The video input unit 120 can receive a video signal via a wired and/orwireless link, and/or may include one or more lenses and an image sensorto capture at least one image. More specifically, the video input unit120 may be a camera which can photograph and/or capture an image, or avideo interface which receives a video signal from another apparatus.

The video encoder 125 can compress the received video signal using videocompression such as MPEG or H.26x to generate video bit stream. Thevideo encoder 125 can output the generated video bit stream to the MP4file format MUX 140. The video encoder 125 can be an integrated circuit,a processor, and/or an encoder to carry out the exemplary embodiments ofthe present general inventive concept disclosed herein.

The capture unit 130 can capture a specific scene of the video signalreceived from the video input unit 120. The capture unit 130 can outputa still image signal for the captured image to the still image encoder135. The capture unit 130 may be an integrated circuit, a processor, afiled programmable gate array, a programmable logic device, and/or anysuitable capture unit to carry out the exemplary embodiments disclosedherein.

The still image encoder 135 can compress the captured still image signalusing a compression such joint photographic experts group (JPEG) and thelike. The still image encoder 135 can store the compressed still imagedata in the storage unit 150.

The still image encoder 135 transmits information for the still image tothe MP4 file format MUX 140.

The MP4 file format MUX 140 can generate a moving image file of theMPEG-4 standard (e.g., the MP-4 standard) using the audio stream outputfrom the audio encoder 115 and the video stream output from the videoencoder 125. The MP4 file format can store the generated MP4 file in thestorage unit 150. The MP4 file format MUX 140 may be a multiplexer, anintegrated circuit, a processor, and/or any suitable multiplexer tocarry out the exemplary embodiments of the present general inventiveconcept as disclosed herein.

The MP4 file format MUX 140 can record separate link information of acontents file included with the moving image file, when the MP4 fileformat MUX 140 generates the moving image file. Herein, the contentsfile may be any one of a moving image contents file, a still imagecontents file, and a text contents file. For example, the MP4 fileformat MUX 140 may record the link information for the stored stillimage file output from still image encoder 135 within the moving imagefile.

Herein, the link information can include information to link theseparate contents file with the moving image file. Accordingly, themoving image file including the link information can be displayedtogether with the linked contents file during reproduction (e.g.,reproduction of the moving image on a display). That is, a user canselect from the link information to reproduce one of the linked items(e.g., a still image file, and audio file, etc.).

The link information can include a file name of the contents file, areproducing starting time point, and reproducing time information. Forexample, the file name of the contents file may be ‘still image.jpg’,the reproducing starting time point may be frame No. 30, and thereproducing time information may be ‘2 minutes’. A detailedconfiguration of the link information will be explained later withreference to FIG. 7.

The link information may be recorded within a meta box or user-defineddata box of the moving image file of the MPEG-4 standard and/or the MP4standard (MPEG-4 and MP4 are interchangeably used herein throughout).The box file structure (i.e., that includes the meta box and/or the userdefined box) can define the best use of the file, and the specificationsto which the file complies.

The MP4 file format MUX 140 can generate the moving image file byincluding the link information when it generates the moving image file.

The storage unit 150 can store the moving image file and the contentsfile. Herein, the moving image file corresponds to a moving image fileof the MPEG-4 standard. The storage unit 150 may be a digital storagedevice, such as one or more hard disk drives, memory devices (e.g.,Random Access Memory (RAM), Flash memory, etc.), solid state drives,and/or any suitable storage unit to carry out the exemplary embodimentsof the present general inventive concept as disclosed herein.

The controller 160 can control the operation of the image storageapparatus 100. The controller 160 may be an integrated circuit, aprocessor, a field programmable gate array, a programmable logic device,an application specific integrated circuit, and/or any other suitablecontroller to carry out the exemplary embodiments of the present generalinventive concept. More specifically, the controller 160 can control theMP4 file format MUX 140 to record the link information of the contentfile within the moving image file and store the moving image fileincluding the link information in the storage unit 150.

The controller 160 can control the link information of the contents fileto be recorded within a meta box or user-defined data box of the MPEG-4standard.

The controller 160 can control the link information of another contentsfile to be included within the moving image file and which is to bestored.

The controller 160 may store the moving image file (e.g., the movingimage file that is formatted in the MPEG-4 standard) in a separaterecording medium (e.g., in a different recording medium from the storageunit 150, or in a different storage area in the storage unit 150). Themoving image file can correspond to a file in which the link informationof the contents file is within a meta box or user-defined box of theMPEG-4 standard. Herein, the recording medium may be a computer-readablerecording medium. For example, a compact disk (CD), a digital versatiledisk (DVD), a Blue-ray disk (BD), a flash memory, a universal serial bus(USB) memory device and the like may be used as the recording medium.

The image storage apparatus 100 can store the moving image file of theMPEG-4 by linking a separate contents file. The image storage apparatus100 can generate the moving image file of the MPEG-4 standard includingthe link information of the separate contents file. When the movingimage file including the link information is reproduced, the linkedcontents file is also displayed for a predetermined period of time(i.e., a specific period).

Hereinafter, an image reproducing apparatus 200 to reproduce a movingimage file of the MPEG-4 as described above will be explained withreference to FIG. 2. FIG. 2 is a view illustrating an image reproducingapparatus according to exemplary embodiments of the present generalinventive concept.

As illustrated in FIG. 2, the image reproducing apparatus 200 caninclude an audio/video (A/V) input unit 210, an A/V processing unit 220,an audio output unit 230, a display unit 240, a storage unit 250, and acontroller 260.

The A/V input unit 210 can receive moving image data including audio andvideo. More specifically, the A/V input unit 210 can receive a movingimage file having a MPEG-4 format. The A/V input unit 210 can be aninterface to receive moving image data via a wired and/or wirelesscommunications link. The A/V input unit may include an image captureapparatus to capture moving images and/or still images, and may includean apparatus to receive sound waves and convert the sound into anelectrical signal.

The A/V processing unit 220 can decode the moving image file of theMPEG-4 format to divide audio data and video data. The A/V processingunit 220 can output the audio data to the audio output unit 230 and thevideo output to the display unit 240. The A/V processing unit 220 can bea processor, an integrated circuit, a programmable logic device, a fieldprogrammable gate array, an application specific integrated circuit,and/or any suitable processing unit to carry out the exemplaryembodiments of the present general inventive concept as disclosedherein.

The storage unit 250 can store the moving image file including acontents file and link information of the contents file. The movingimage file is a moving image file of the MPEG-4 format. The linkinformation for the contents file stored in the storage unit 250 can berecorded within a meta box or user-defined box of the moving image fileof the MPEG-4 standard. The storage unit 250 may be a digital storagedevice, such as one or more hard disk drives, memory devices (e.g.,Random Access Memory (RAM), Flash memory, etc.), solid state drives,and/or any suitable storage unit to carry out the exemplary embodimentsof the present general inventive concept as disclosed herein.

The controller 260 can control the operation of the image reproducingapparatus 200. More specifically, the controller 260 can control thereproduction of the moving image file stored in the storage unit 250.The controller 260 can be a processor, an integrated circuit, aprogrammable logic device, a field programmable gate array, anapplication specific integrated circuit, and/or any suitable controllerto carry out the exemplary embodiments of the present general inventiveconcept as disclosed herein.

The controller 260 can control the display of a reproducing screen ofthe moving image file together with a reproducing screen of the contentsfile for a predetermined period of time (e.g., specific period) based onthe link information when reproducing the moving image file. Forexample, the controller 260 can control the display of the reproducingscreen of the contents file on the reproducing screen of the movingimage file in a picture in picture (PIP) screen.

The link information can include a file name of the contents file, areproducing starting time point, and reproducing time information. Forexample, a file name of the moving image file can be ‘movingimage1.mp4’, the file name of the contents file included in the linkinformation of the moving image file can be ‘still image.jpg’, thereproducing starting time point can be frame No. 30, and the reproducingtime information can be ‘2 minutes’. When a frame of frame No. 30 of‘moving image1.mp4’ is reproduced, the controller can display ‘stillimage.jpg’ on the screen. After 2 minutes have elapsed, the controller260 can remove ‘still image.jpg’ that is displayed on the screen.

When a time point is reached where the contents file is to be displayedbased on the link information during reproducing the moving image, thecontroller 260 can control the display of the reproducing screen of themoving image together with the reproducing screen of the contents fileduring a reproducing period.

As described above, the image reproducing apparatus 200 can reproducethe moving image file and can reproduce another contents file linkedwith the moving image file for a predetermined period or time.

Thus, since another contents file is linked with the moving image fileof the MPEG-4 standard, a user can confirm the linked contents file onone screen when the user reproduces the moving image. The user canconfirm the contents file which is a link target by independentlyreproducing the contents file.

Hereinafter, a method of storing an image and a method of reproducing animage will be explained with reference to FIGS. 3 and 4.

FIG. 3 is a flowchart illustrating a method of storing an imageaccording to exemplary embodiments of the present general inventiveconcept.

The image storage apparatus 100 can separately store a contents file atoperation S310.

When the image storage apparatus 100 generates a moving image file, itcan record link information of the contents file within the moving imagefile at operation S320. Herein, the contents file may be any one of amoving image contents file, a still image contents file, and a textcontents file.

The moving image file can be a moving image file of the MPEG-4 standard.The link information may be recorded in a meta box or user-defined databox of the moving image file of the MPEG-4 standard.

The image storage apparatus 100 can store the moving image in which thelink information is recorded at operation S330. For example, the imagestorage apparatus 100 may record link information for the captured andstored still image file within the moving image file.

Through the above-described method, the image storage apparatus 100 canstore the moving image file link with another contents file.

FIG. 4 is a flow chart illustrating a method of reproducing an imageaccording to exemplary embodiments of the present general inventiveconcept.

The image reproducing apparatus 200 can reproduce the stored movingimage file according to a user's received input at operation S410. Thereproducing moving image file can be a moving image file of the MPEG-4standard which can be linked with another contents file.

The image reproducing apparatus 200 can determine where a reproducingstarting time point of the linked contents file is or not based on thelink information, during reproducing the moving image file at operationS420.

If the reproducing starting time point reaches at operation S420-Y, theimage reproducing apparatus 200 can display a reproducing screen of themoving image file together with a reproducing screen of the contentsfile for a predetermined period (i.e., a specific period) based on thelink information at operation S430. For example, the image reproducingapparatus 200 can display the reproducing screen of the contents file onthe screen which displays the moving image in PIP screen.

The image reproducing apparatus 200 can determine whether a terminationtime point of a reproducing time of the contents file is or not based onthe reproducing time information of the link information at operationS440. If the reproducing time of the contents file at operation S440-Ndoes not reach the termination time point, the image reproducingapparatus 200 can continuously display the moving image file and thecontents file at operation S430.

When the reproducing time reaches the termination time point atoperation S430-Y, the image reproducing apparatus 200 can remove thereproducing screen of the contents file and can continuously displayonly the reproducing screen of the moving image at operation S450.

For example, it can be assumed that a file name of the moving image fileis ‘moving image 1.mp4’, a file name of the contents file included inthe link information of the moving image file is ‘still image.jpg’, areproducing starting time point is frame No. 30, and the reproducingtime information is ‘2 minutes’. When a frame of frame No. 3 in ‘movingimage 1.mp4’ starts to be reproduced, the image reproducing apparatus200 can display ‘still image.jpg’ on a screen together with thereproducing image of the moving image file. When 2 minutes have elapsed,the image reproducing apparatus 200 can remove ‘still image.jpg’ that isdisplayed on the screen.

Thus, when the time point where the other contents are to be displayedis during the reproducing of the moving image file, the imagereproducing apparatus 200 can display the reproducing screen of themoving image file as well as the reproducing screen of the contents fileduring a reproducing period.

As above described, the image reproducing apparatus 200 can reproducethe moving image file, as well as reproduce the moving image file andthe contents file linked with the moving image file for a predeterminedtime.

Since another contents file can be linked within a moving image file ofthe MPEG-4 standard, when a user reproduces the moving image file, theuser can confirm the moving image file together with the contents fileon one screen. The user may confirm the contents file of a link targetby independently reproducing the contents file.

Hereinafter, a configuration of a moving image file of the MPEG-4 and adetailed configuration of link information included in the moving imagefile will be explained with reference to FIGS. 5 to 9.

FIG. 5 is a view illustrating a MPEG-4 file format according toexemplary embodiments of the present general inventive concept. FIG. 5is a view illustrating a file format according to the MPEG-4 standard,and the format is can be referred to as a container configuration of anMPEG-4 file. The container configuration of the MPEG-4 file can beconfigured from boxes that may include various data. The above-describedconfiguration can comply with the MPEG-4 standard, and a detaileddescription for each box will be omitted and only parts of the exemplaryembodiments of the present general inventive concept will be brieflyexplained.

As illustrated in FIG. 5, the MPEG-4 file can include a ftyp box 510, amoov box 520, mdat box 530, and a meta box 540.

The ftyp box 510 can be a box area in which information for a file typeof the MPEG-4 file is stored.

The moov box 520 can be an area in which information for contents of theMPEG-4 file is recorded in detail. As illustrated in FIG. 5, the moovbox 520 can include a mvhd box 521, a video trak box 523, an audio trakbox 525, a trak box 527, and an udta box 529.

The mvhd box 521 can correspond to a box in which header information forthe moving image contents is recorded. The video trak box 523 can be abox in which information for a video part of the moving image isrecorded. The video trak box 523 can include a tkhd box, where the tkhdbox can include a tref box. The video trak box 523 can include a mdiabox, where the mdia box can include a mdhd box, a hdlr box, and a minfbox. The tkhd, tref mdia, mdhd, hdlr and minf boxes are boxes of theMPEG4 standard. The tkhd box may include track header information, thetref box may include track reference information, the mdia box mayinclude media information, the mdhd box may include media headerinformation, the hdlr box may include a handler declaration, and theminf box may include media information.

The audio trak box 525 can be a box in which an audio part of the movingimage is recorded. Trak box 527 may include track header information.The udta box 529 is an area in which information arbitrarily set by auser can be recorded and can correspond to a user-defined data box.

The mdat box 530 can correspond to a box area in which substantialcontents data is recorded.

The meta box 540 can correspond to a meta box including meta informationof contents. The meta box 540 includes an iloc box (item location box)and an inf box (item information box).

For the MPEG-4 moving image file of the above-described configuration,link information can be recorded in a box type within the udta box 529or the meta box 540.

FIG. 6 is a view illustrating a method of reproducing an MP4 fileaccording to exemplary embodiments of the present general inventiveconcept. As illustrated in FIG. 6, link information can be included in‘A.MP4 stream’ which is a moving image file, and the link informationcan include a link for ‘B.Contents’ which is another contents file.

An image reproducing apparatus 630 can read out (e.g., simultaneouslyread out) ‘A. MP4 Stream’ of the moving image file and ‘B. Contents’ ofthe contents file to transmit them to a display device 640. When it istime to reproduce the linked contents file based on the linkinformation, the display device 640 can display a reproducing screen 655of the contents file within a reproducing screen 650 of the moving imagefile in a PIP screen type.

When the moving image file linked with the contents file is reproduced,the display device 640 can display the reproducing screen 650 of themoving image file together with the reproducing screen 660 of thecontents file.

FIG. 7 is a view illustrating a link information box based on the MPEG-4format according to exemplary embodiments of the present generalinventive concept. As illustrated in FIG. 7, the link information box(external data link information box: Edli) can include size information,type information, version information, entry count information, data_IDinformation, Sync_Sample-Num information, Play_Duration information, anddata_name information.

The size information can include the whole size of the link informationbox.

The type information can include type information of the linkinformation box, and “edli” can indicate that the present box is thelink information box. The title of the type may be changed.

The version information can include a version of the link informationbox.

The entry count information can include a number of data correspondingto the link information. For example, in the case where four (4)contents files are linked with the moving image file, the entryinformation can be four.

The data_ID information can be information that includes a contents tobe a link target. For example, data_ID of JPEG contents may be ‘0x01’,data_ID of text contents may be ‘0x02’, data_ID of MP4 contents may be‘0x03’, data_ID of MOV contents may be ‘0x04’, and data_ID of audiovideo interleaving (AVI) contents may be ‘0x05’. Herein, the JPEGcontents includes still image contents and the AVI contents, the MOVcontents, and where the AVI contents include moving image contents.

The Sync_Sample_Num information includes a reproducing starting timepoint of a contents file with respect to a reproducing time of a movingimage file. That is, the Sync_Sample_Num information can includereproducing starting time point information of a contents file. Thereproducing starting time point may include a reproducing time of themoving image file or a frame number of the moving image file. Forexample, when the contents file is a captured still image, thereproducing starting time point information may be a time point wherethe still image file is captured within the reproducing time of themoving image file. When the contents file is a moving image filephotographed by a separate camera, the reproducing starting time pointinformation may be a time point where the contents file (that is, thephotographed moving image file) starts to be photographed within thereproducing time of the moving image file.

The Play_Duration information can include time information at which acontents time is reproduced. In other words, the Play_Durationinformation can be reproducing time information for the contents file.For example, when the contents file is a captured still image file, thereproducing time information may be a preset time. When the contentsfile is a moving image file photographed by a separate camera, thereproducing time point information can be a reproducing time of thecontents file (that is, the photographed moving image file).

The name_file information includes file name information of a contentsfile.

Thus, various information can be recorded to comply with a box standardbased on the MPEG-4 format in the link information box.

FIG. 8 is a view illustrating when link information is included within auser-defined data box according to exemplary embodiments of the presentgeneral inventive concept. As illustrated in FIG. 8, it can be confirmedthat a link information box 800 together with a file information box anda network information box are included within a user-defined data box.

FIG. 9 is a view illustrating when link information is included within ameta data box according to exemplary embodiments of the present generalinventive concept. As illustrated in FIG. 9, it can be confirmed that alink information box 900 together with an item location box and an iteminformation box can be included within a meta data box.

As described above, the link information box can be included in theuser-defined data box or meta data box within the moving image file bycomplying with the MPEG-4 standard.

Hereinafter, methods of generating and reproducing a moving image filewith which a still image file is linked is described with reference toFIGS. 10 to 12C.

FIG. 10 is a view illustrating a detailed configuration of a camcorderaccording to exemplary embodiments of the present general inventiveconcept. FIG. 10 illustrates where the image storage apparatus 100 ofFIG. 1 can be a camcorder. Accordingly, in FIG. 10, the audio input unit110 can be a microphone and the video input unit 120 can be a cameraunit. In FIG. 10, description of parts which are the same as those ofFIG. 1 will be omitted and only other parts will be described.

As illustrated in FIG. 10, the camcorder that is the image storageapparatus 100 can include a user controller 1020 and a file writer 1030.The user controller 1020 can receive an input control signal from a userto perform a capture operation and can transmit the input control signalto a capture unit 130.

The file writer 1030 can generate a JPEG (Joint Photographic ExpertsGroup) stream which is an encoded still image file in a file type andcan store the generated JPEG file in a storage unit 150. The file writer1030 may be an integrated circuit, a processor, and/or any othersuitable device to generate a data stream and encode a still image fileaccording to the exemplary embodiments of the present general inventiveconcept as disclosed herein.

An operation of the camcorder that is the image storage apparatus 100 ofFIG. 10 will be described as follows.

The microphone of the audio input unit 110 can convert sound into audiodata. The microphone of the audio input unit 110 can transmit the audiodata 10 to an audio encoder 115. The audio encoder 115 may be anintegrated circuit, a processor, and/or any suitable encoder to carryout the exemplary embodiments of the present general inventive conceptas disclosed herein. The audio encoder 115 can compress the audio data10 in audio stream 11 and can transmit the audio stream 11 to an MP4file format MUX 140.

The camera of the video input unit 120 can photograph a moving image andcan transmit photographed video data 20 to a video encoder 125. Thevideo encoder 125 may be an integrated circuit, a processor, and/or anysuitable encoder to carry out the exemplary embodiments of the presentgeneral inventive concept as disclosed herein. The video encoder 125 cancompress the video data 20 in video stream 21 and can transmit the videostream 21 to the MP4 file format MUX 140.

The capture unit 130 can capture the photographed image based on thecontrol input received via the user controller 1020. The capture unit130 can transmit the captured video data 20 to a still image encoder(JPEG encoder) 135. The still image encoder 135 can be a processor, anintegrated circuit, or any suitable encoder to carry out the exemplaryembodiments of the present general inventive concept. The still imageencoder 135 can compress the captured video data 20 in still imagestream (JPEG steam) 22 and can transmit the still image stream 22 to thefile writer 1030.

The file writer 1030 can generate a still image file (JPEG file) 24using the still image stream 22 and can store the generated still imagefile 24 in the storage unit 150. The file writer 1030 can transmit astill image information signal (JPEG info signal) 101 to the MP4 fileformat MUX 140. Herein, the still image information signal can beinformation provided to generate link information and can include filename information of the still image file, reproducing starting timepoint information, and reproducing time information.

The MP4 file format MUX 140 can generate a MP4 moving image file (MP4file) 23 using the audio stream 11 and the video stream 21 and can storethe MP4 moving image file in the storage unit 150. The MP4 file formatMUX 140 can include the link information in the MP4 moving image file 23using the still image information signal 101 and can store the MP4moving image file including the link information.

The link information may include a file name of the still image filecaptured by the capture unit 130, a reproducing starting time point, andreproducing time information. Herein, the reproducing starting timepoint can be a time point where the still image file is captured withina reproducing time of a moving image that is being photographed. Thereproducing time can be a preset time. More specifically, if a stillimage was captured at time point where 10 minutes have elapsed after amoving image begins to be photographed, a name of the still image fileis ‘still image 1.jpg’ and the reproducing time of the still image isset as 2 minutes, a controller 160 can set the name of the still imagefile as ‘still image 1.jpg’, the reproducing starting time point as 10minutes, and the reproducing time as 2 minutes for the link informationof the photographed moving image.

The above process can be controlled to be performed by the control unitof the camcorder of the image storage apparatus 100. More specifically,when the moving image is photographed by the camera unit 110 and whenthe still image is captured by the camera unit 110, the controller cancontrol the storage of the captured still image file in the storage unitand can record link information for the still image file within themoving image file.

FIG. 11 is a view illustrating an example of link information for astill image file according to exemplary embodiments of the presentgeneral inventive concept. FIG. 11 illustrates where a link informationbox 1110 can be stored within a user-defined data box 1100 of a movingimage file.

In FIG. 11, n still images can be linked with a moving image file withinthe link information box 1110. Therefore, the Entry count can be ‘1 ton’.

Referring to first still image file link information 1111, data_ID canbe ‘0x01’ so as to indicate a JPEG still image file. Sync_Sample_Num canbe ‘30’ so as to indicate that a reproducing starting time point of afirst still image file is a 30^(th) frame of a moving image file.Play_Duration can be ‘60’ so as to indicate that a reproducing time ofthe first still image file is 60 seconds. Data_name can be‘sam_(—)0001.jpg’ so as to indicate a file name of the first still imagefile.

A second still image file link information 1113 to nth still image filelink information 1115 can be included in the link information box 1110.

Thus, a plurality of still image files may be linked in the linkinformation box 1110.

FIGS. 12A to 12C are views illustrating methods of linking a still imagewith a moving image captured by a camcorder, storing the moving imagelinked with the still image, and reproducing the moving image accordingto exemplary embodiments of the present general inventive concept.

FIG. 12A illustrates where a moving image file (moving image.mp4) isphotographed by the camera unit 120 of the camcorder of the imagestorage apparatus 100. At the time point where 20 minutes have elapsedafter the moving image file begins to be photographed, the camcorder 100can capture a still image file (still image.jpg) by the control of auser.

A moving image file 1210 and a still image file 1220 can be separatelystored in the storage unit 150. Link information for a still image filecan be included in the moving image file 1210. A reproducing startingtime point of the still image (e.g., when 20 minutes is within areproducing time of the moving image) can be set at the time point wherethe still image is captured.

FIG. 12B is a view illustrating a screen on which the moving image file1210 photographed by the camcorder of the image storage apparatus 100can be reproduced in the image reproducing apparatus 200. As illustratedin FIG. 12B, the image reproducing apparatus 200 can display areproducing screen 1230 of the moving image file 1210 on screen. Forexample, a present reproducing time can be 1 second.

FIG. 12C is a view illustrating a screen on which the moving image file1210 photographed by the camcorder of the image storage apparatus 100together with the still image file 1220 can be reproduced in the imagereproducing apparatus 200.

In FIG. 12C, the image reproducing apparatus 200 can reproduce themoving image file at the time point where the reproducing time of themoving image file 1210 can be 20 minutes. According to the linkinformation of the moving image file 1210, it is recorded that the stillimage is displayed at the time point where the reproducing time of themoving image file reaches 20 minutes.

Accordingly, the image reproducing apparatus 200 can display thereproducing screen 1230 of the moving image file together with thereproducing screen 1240 of the still image file in a PIP screen type.

The image apparatus 200 can display the still image for a preset time(for example, 2 minutes) set in the reproducing time information of thelink information in a PIP type. If the preset time elapses, the imagereproducing apparatus 200 can display only the reproducing screen 1230of the moving image file as illustrated in FIG. 12B.

The camcorder of the image storage apparatus 100 can capture thephotographing image and link the captured still image file with thephotographing moving image file. Accordingly, it can be set that a usercan photograph the moving image and capture the specific frame of thephotographed moving image to display it together with the moving image.

As described above, since the captured still image file can be linked inthe moving image file of the MPEG-4 standard, the moving image can bereproduced together with the linked still image on one screen. The usercan select the capture still image included in a link target so as toindependently reproduce the capture still image.

Hereinafter, methods of generating and reproducing a moving image withwhich another moving image file can be linked according to exemplaryembodiments of the present general inventive concept is described belowwith reference to FIGS. 13 to 15C.

FIG. 13 is a view illustrating a detailed configuration of a camcorderaccording to exemplary embodiments of the present general inventiveconcept. FIG. 13 illustrates that the image storage apparatus 100 ofFIG. 1 can be a camcorder. Accordingly, as illustrated in FIG. 13, theaudio input unit 110 can be a microphone and a video input unit 120 canbe a camera unit. The video input unit 120 may be any suitable apparatusto capture video and/or still images. For example, the video input unit120 may include one or more lenses and an image sensor to convertreceived light into an electrical signal which may be used by the imagestorage apparatus 100. Description of parts of FIG. 13 which are thesame as those of FIGS. 1 and 12 will be omitted and only other partswill be explained

As illustrated in FIG. 13, a camcorder of the image storage apparatus100 further includes an additional camera unit 1300, an additional videoencoder 1310 and an additional MP4 file format MUX 1320 as compared withFIG. 12. Accordingly, the camcorder of the image storage apparatus 100can photograph two moving images at once. The camera unit 1300 mayinclude one or more lenses and an image sensor to capture a still imageand/or a moving image, and the video encoder 1310 may be an integratedcircuit, processor, an/or any suitable encoder to carry out theexemplary embodiments of the present general inventive concept asdisclosed herein.

More specially, as illustrated in FIG. 13, the additional camera unit1300 can photograph (e.g., capture) another moving image differentlyfrom the camera unit 110. The camera unit 1300 can transmit thephotographed video data 30 to the video encoder 1310. The encoder 1310can compress the video data 30 in video stream 31 and can transmit thevideo stream to the MP4 file format MUX 1320.

The MP4 file format MUX 1320 can generate an additional MP moving imagefile (MP4 file) 33 using an audio stream 11 and the video stream 31 andcan store the MP4 moving image file 33 in a storage unit 150.

The MP4 file format MUX 1320 can transmit a moving image informationsignal (MP4 infor signal) 102 to a MP4 file format MUX 140. Herein, themoving image information signal 102 can be information provided togenerate link information and can include a file name information of theadditional moving image file 33, reproducing starting time pointinformation, and reproducing time information.

Herein, the reproducing starting time point can be a time point wherethe additional moving image file 33 can be captured within a reproducingtime of the moving image file being photographed, and the reproducingtime can be a reproducing time of the additional moving image file 33.

The MP4 file format MUX 140 can generate an MP4 file moving image file(MP4 file) 23 using the audio stream 11 and video stream 21 and canstore the MP4 moving image file 23 in the storage unit 150. The MP4 fileformat MUX 140 can generate link information to be included in the MP3moving image file 23 by using the moving image information signal 102,and can store the MP4 moving image file 150 including the linkinformation.

The link information may include a file name of the moving image file 33photographed by the additional camera unit 1300, a reproducing startingtime point, and reproducing time information. Herein, the reproducingstarting time point can be a time point where the additional movingimage file 33 is captured within a reproducing time of the moving file23 being disposed, and the reproducing time is a reproducing time of theadditional moving image file 33. More specifically, when the additionalmoving image is photographed at the time point where 10 minutes haveelapsed after the moving image begins to be photographed, a name of theadditional moving image file can be ‘moving image 1.mp4’. When theadditional moving image file has been photographed for total 2 minutes,the camcorder 100 can set the file name as ‘moving image 1.mp4’. Thereproducing starting time point can be set as 10 minutes, and thereproducing time can be set as 2 minutes in the link information of thephotographed moving image.

The above-described method can be controlled so as to be performed by acontroller of the camcorder of the image storage apparatus 100. Morespecifically, when the camera unit 110 is photographing the moving image(video data) 20, if the additional moving image (video data) 30 isphotographed by the additional camera unit 1300, the controller cancontrol the storage of the photographed additional moving image file 33and can control the storage of the link information for the photographedadditional moving image file 33 within the photographing moving imagefile 23.

FIG. 14 is a view illustrating an example of link information 1400 for astill image file and a moving image file according to exemplaryembodiments of the present general inventive concept. FIG. 14illustrates where a link information box 1410 is stored within auser-defined data file of a moving image file.

As illustrated in FIG. 14, n still images can be linked with a movingimage within the link information box 1410. Accordingly, the Entry countcan be 1 to n′.

This is similar to the link information box 1110 of FIG. 11. However,only the still image may be linked in FIG. 11, but the second movingimage file link information 1413 can be included in the link informationbox 1410 in FIG. 14. For convenience of description, an original movingimage file may be referred to as a first moving image file and a filewhich is a link target may be referred to as a second moving image file.

Referring to the second moving image file link information 1413, data_IDmay be ‘0x03’ so as to indicate a MP4 moving image, and Sync_Sample_Nummay be ‘300’ so as to indicate that the a reproducing starting timepoint of the second moving file can b e a 300^(th) frame of the firstmoving image file. In addition, Play_Duration can be ‘60’ so as toindicate that a reproducing time of the second moving image is 60seconds, and data_name can be ‘hdv_(—)0001.mp4’ so as to indicate a filename of the second moving image file.

The first still image file link information 1411 to the nth still imagelink information 1415 can be included in a link information box 1410.

Thus, a plurality of still image files and a plurality of moving imagefiles can be linked in the link information box 1410.

FIGS. 15A to 15C are views illustrating methods of linking a secondmoving image in a first moving image photographed by a camcorder of theimage storage apparatus 100, storing the linked first moving image, andreproducing the first moving image.

FIG. 15A illustrates where the first moving image file (moving image1.mp4) is photographed by a camera unit 120 of the camcorder of theimage storage apparatus 100. The camcorder of the image storageapparatus 100 can capture the second moving image file (moving image2.mp4) via an additional camera 1300 under the control of a user at thetime point where 20 minutes have elapsed after the first moving imagefile begins to be photographed.

A first moving image file 1510 and a second moving image file 1520 canbe separately stored in a storage unit 150, and the link information forthe second moving image file can be included in the first moving imagefile 1510. More specifically, a reproducing time point of the secondmoving image file 1520 (when a first moving image reproducing timereaches at 10 minutes) can be set as a time point where the secondmoving image starts to be photographed.

FIG. 15B illustrates a screen on which the first moving image file 1510photographed by the camcorder of the image storage apparatus 100 can bereproduced by the image reproducing apparatus 200. As illustrated inFIG. 15B, the image reproducing apparatus 200 can display a reproducingscreen 1530 of the first moving image file 1510 on a screen. Forexample, a present reproducing time is 1 second.

FIG. 15C illustrates a screen on which the first moving image file 1510photographed by the camcorder of the image storage apparatus 100together with the second moving image file 1520 can be reproduced in theimage reproducing apparatus 200.

In FIG. 15C, the image reproducing apparatus 200 can reproduce the firstmoving file 1510 at the time point where the reproducing time of thefirst moving image reaches 10 minutes. Referring to the link informationof the first moving image file 1510, the second moving image file can bedisplayed at the time point where the reproducing time of the firstmoving image file 1510 reaches at 10 minutes.

Accordingly, the image reproducing apparatus 200 can display areproducing screen of the first moving image file 1530 together with areproducing screen 1540 of the second moving image in a PIP screen type.

The image reproducing apparatus 200 can display the second moving imagefile for a time set in the reproducing time information of the linkinformation (that is, the reproducing time of the second moving imagefile) in a PIP type. If the reproducing time of the second moving imagefile 1520 elapses, the image reproducing apparatus 200 can display onlythe reproducing screen 1530 of the moving image file as illustrated inFIG. 15B.

Thus, the camcorder of the image storage apparatus 100 can photograph anadditional moving image and link the photographed additional movingimage file with the moving image file which is being displayed.Accordingly, user can photograph two moving images using the camcorderof the image storage apparatus 100. One moving image may be set to bedisplayed together with another moving image at a specific time point.

As described above, since the captured another moving image file islinked within the moving image file of the MPEG-4 standard, when a userreproduces the moving image file, the user can select that the movingimage be displayed together with the linked another moving image file onthe screen. The user can select the additional moving image file whichis a link target so as to independently reproduce the additional movingimage file.

Although the exemplary embodiments of the present general inventiveconcept illustrate a camcorder as a photographing apparatus, anyapparatus capable of photographing a moving image file may be usedaccording to the exemplary embodiments of the present general inventiveconcept. For example, the photographing apparatus may be a digitalcamera, a mobile phone with a camera, a portable computer, a personaldigital assistant (PDA), and the like.

The present general inventive concept can also be embodied ascomputer-readable codes on a computer-readable medium. Thecomputer-readable medium can include a computer-readable recordingmedium and a computer-readable transmission medium. Thecomputer-readable recording medium is any data storage device that canstore data as a program which can be thereafter read by a computersystem. Examples of the computer-readable recording medium includeread-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetictapes, floppy disks, and optical data storage devices. Thecomputer-readable recording medium can also be distributed over networkcoupled computer systems so that the computer-readable code is storedand executed in a distributed fashion. The computer-readabletransmission medium can be transmitted through carrier waves or signals(e.g., wired or wireless data transmission through the Internet). Also,functional programs, codes, and code segments to accomplish the presentgeneral inventive concept can be easily construed by programmers skilledin the art to which the present general inventive concept pertains.

Although various example embodiments of the present general inventiveconcept have been illustrated and described, it will be appreciated bythose skilled in the art that changes may be made in these exampleembodiments without departing from the principles and spirit of thegeneral inventive concept, the scope of which is defined in the appendedclaims and their equivalents.

1. An image reproducing apparatus, comprising: a display unit; a storageunit which stores a first content and a second content which includesreproducing duration time information of the first content; and acontroller which controls the display unit to reproduce the firstcontent for a specific period based on the reproducing duration timeinformation while the second content is being reproduced, wherein thecontroller reproduces the first content and the second contentsimultaneously for the specific period, and reproduces only the secondcontent for a period other than the specific period.
 2. The apparatus asclaimed in claim 1, wherein the first content comprises audio data, andthe second content comprises a still image.
 3. An image reproducingmethod, comprising: storing a first content and a second content whichincludes reproducing duration time information of the first content;controlling a display unit to reproduce the first content for a specificperiod based on the reproducing duration time information while thesecond content is being reproduced, wherein the first content and thesecond content are reproduced simultaneously for the specific period,and only the second content is reproduced for a period other than thespecific period.
 4. The method as claimed in claim 3, wherein the firstcontent comprises audio data, and the second content comprises a stillimage.